Search AI Products and News

In the field of artificial intelligence, the DeepSeek team recently released their latest research成果, introducing an innovative sparse attention mechanism named NSA (Native Sparse Attention). The core objective of this technology is to enhance the speed of long context training and inference, particularly optimized for modern hardware, significantly improving the efficiency of training and inference. The launch of NSA technology brings significant changes to the training of artificial intelligence models. Firstly, it utilizes a series of advancements tailored for modern computational hardware.

Google Research recently announced the innovative 'Titans' series model architecture, achieving a groundbreaking 2 million token context length through bionic design, with plans to open-source related technologies in the future. The core innovation of this architecture is the introduction of a Deep Neural Long-Term Memory Module, inspired by the human memory system. Titans cleverly combines the rapid response capability of short-term memory with the persistence characteristics of long-term memory, while utilizing an attention mechanism to handle immediate context, forming an efficient information processing system.

The domestic open source video generation model CogVideoX-5B has been officially released in the Mota ModelScope community, significantly improving the quality and visual effects of video generation. Based on the large-scale DiT model, this model utilizes a 3D causal variational autoencoder and expert Transformer technology, achieving spatio-temporal joint modeling through 3D-RoPE positional encoding and a 3D full attention mechanism. The use of progressive training techniques allows the model to generate long videos with distinct motion features, coherence, and high quality.

In July this year, Aishi Technology released the newly upgraded AI video generation product PixVerse V2, which is based on the Diffusion+Transformer (DiT) architecture, achieving multiple innovations in video generation technology. PixVerse V2 offers longer, more consistent, and more engaging video generation capabilities, supporting the generation of multiple video clips at once.